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1.  Introduction.  Let  (X^,Y^)  ( i=l , 2 , . . , , n)  be  i.i.d.  as 

(X,Y) . If  the  X^  are  arranged  in  ascending  order  as  the 
order  statistics  (r=l , 2 , , . . , n)  , the  Y-variate  associated 

with  X may  be  denoted  by  Y . i and  termed  the  concomitant 

of  the  r'"  order  statistic.  The  class  of  statistics  which  are 
linear  functions  of  order  statistics  has  received  consideradale 
attention  in  recent  years.  A great  deal  of  efforts  have  been 
spent  on  looking  into  conditions  under  which  such  statistics 


are  asymptotically  normal.  However  hardly  any  work  has  been 
done  on  linear  function  of  the  concomitants  of  order  statistics 

-1  r 

n I C.  Yf.  , . Recently  Bhattacharya  (1974,1976)  and 

Sen  (1976)  have  considered  asymptotic  behavior  of  the  sums 
[nt] 

J 7t?/v  ^ I where  they 

i=l  li:nj  ^F(X^:n)  < t [i:nj  ^ 

called  the  Y..  , the  "induced  order  statistics".  It  is 

li:n] 

the  purpose  of  this  paper  to  investigate  the  asymptotic  be- 
havior and  statistical  applications  of  statistics  of  the  form 
n 

\ C.  Y..  , . 

in  [i:n] 

In  section  2,  we  shall  consider  statistics  of  the  form 
n 

-1  r i 

= n I ^n+r^  ^ [i  • n]  more  generally 

n 

-1  r i 

4»n  ~ ^n+r^  ^ [i;n]  ^ ' where  J is  a smooth 

bounded  function  and  H(x,y)  is  some  real-valued  function 


Dist.  ■ .,VA!!..  ii,V. 
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defined  on  the  2-dimensional  Euclidean  space.  Section  2.1  to 
2.2  introduces  the  paper  notation  and  gives  a number  of  results 
(some  known)  which  are  needed  in  later  proofs.  These  sections 
may  be  skimmed  and  referred  back  when  necessary.  In  section  2.3, 
under  faily  mild  conditions,  the  asymptotic  normality  of 
is  established.  The  asymptotic  formulas  for  the  mean  and 
variance  of  are  also  obtained.  The  same  asymptotic  re- 

sults are  also  obtained  for  . The  method  of  proof  adopted 
is  essentially  same  as  that  used  by  Stigler  (1969,  1974)  for 
proving  asymptotic  normality  of  linear  function  of  order 
statistics.  In  fact  it  is  closely  in  line  with  his  1974  paper. 

In  section  3,  two  applications  are  also  considered.  First, 
the  technique  developed  and  results  obtained  in  section  2 are 
applied  to  construct  consistent  estimators  of  the  form 

■’n  to  a 

Dirac  delta  function  as  n -+  «>  , for  estimating  various  con- 

ditional quantities,  for  example,  E(y]x=x)  , P(Yga1x=x)  and 
Var(Y|x=x)  . Under  certain  regularity  conditions,  the  asymptotic 
normality  of  M is  also  established.  Second,  based  on  a 
statistics  of  the  form  41^  a large  sample  test  is  proposed 
for  testing  a one-sided  hypothesis  concerning  a specified 
regression  function. 

2 . Asymptotic  Normality. 

2.1  Notation.  Let  (X^,Y^)  ( i=l , 2 , . . . ,n)  be  i.i.d.  as  (X,Y)  . 


2.1  Notation. 
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Then  the  ordered  X-variate  is  denoted  by  X and  the 

r : n 

associated  Y-variate,  the  concomitant  of  the  r^^  ordered 
statistic,  by  ^[j-*n]  ’ convenience  the  following  notation 

will  also  be  adopted  through  out  this  paper: 


F(x)  = cdf  of  the  X-variate  . 

h"  Vi 

F (x)  = cdf  of  the  r order  statistics  X 
r : n r : n 

m(x)  = E(y1x=x)  . 

(x)  = Var  (y1x=x)  . 

F ^ (u)  = inf {x I F (x) =u}  . 

J{u)  is  continuous  a.e.  moF  ^ = J (u)  and  moF  ^(u)  possess 
no  common  discontinuities. 


2.2  Some  useful  results.  In  this  section  we  shall  present 
several  results  which  will  be  used  in  the  proofs  of  the  main 
results  of  this  section. 

As  in  Stigler  (1969  and  1974),  we  shall  use  Hajek's  pro- 
jection lemma  to  obtain  a sum  of  independent  identically  dis- 
tributed random  variables  which  is  asymptotically  equivalent  in 
mean  squares  to  . For  easier  reference,  we  shall  state 

the  lemma  as  Proposition  1. 

Proposition  1.  (Hajek  1968).  Let  Z^^,...,Z^  be  independent 

random  variables  and  S = S(Zj^ , . . . , Z^)  be  a statistic  depending 

2 

on  Zj^,...,Z^  such  that  E S < <» . Define  the  projection  of 

\ 


S to  be 
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n 

(1)  S = I E(SlZ.)  - (n-1)  E S . 

i=l 

Then 

(2)  E S = E S 
and 

(3)  E(S-S)^  = Var  S - Var  S . 


The  following  three  propositions  will  be  used  repeatedly  in 
the  derivations  of  our  main  results. 

Proposition  2.  Suppose  h(x)  can  be  expressed  as  a 
difference  of  two  increasing  right  continuous  functions  of  the 
real  line,  Y is  any  random  variable  with  cdf  G , and 
E 1 h (Y)  I < “>  . Then 


(4) 

(5) 


h (y)dG  (y) 


h (y ) dG  (y) 


[l-G(y)  ]dh(y) 


f h{a)  [l-G(a)  ] 


a 

G(y)dh(y)  + h(a)G(a)  . 


Proof . We  shall  only  consider  (4).  Similar  arguments  can 
be  used  to  show  (5).  Without  loss  of  generality,  we  can  assume 
h(y)  is  an  increasing  right  continuous  function  of  y . Then 
we  may  write 
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/ 


[h (y) -h (a) ]dG (y) 


Since  E[h(Y)l  < “ , by  Fubini's  Theorem  we  can  interchange 

order  of  integrations  and  the  resulting  expression  is  reduced  to 


U-G(t)  ]dh( 


t)  . 


Clearly  the  resulting  equation  yields  (4). 

Proposition  3.  Let  X and  Y be  any  two  random  variables 
with  joing  distribution  given  by  G(x,y)  and  marginal  distributions 
F (x)  and  H(x)  respectively,  and  g(x)  be  any  real-valued 
function  which  can  be  expressed  as  a difference  of  two  increasing 
right  continuous  functions.  Then 


(6) 


Cov(g(X) ,g(Y) ) = / / [G (x,y) -F (x) H (y) ]dg (x)dg (y) 


— OO  ••QO 


provided  E(g(X)g(Y))  , E(g{X))  and  E(g(Y))  exist. 


The  proof  is  essentially  the  same  as  that  given  in  Lehman  (1966) 
for  proving  the  special  case  g(x)  = x , which  is  attributed 
to  Hoeffding  (1948) . 


\ 
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Proposit.^on  4.  Assume  J (u)  is  bounded  and  continuous 

a.e.  on  F ^ , g(x)  is  a real  valued  function  and  X is  a 

random  variable  with  distribution  F(x)  such  that  F,|g(X)  j < “ . 
Then 

r 

(7)  lim  E n"^  I j(  ^ )g(X  ) 

n ►<»  L i=l 

J (F  (x)  ) g (x)  dF  (x)  / 


provided  that  one  of  the  following  conditions  holds: 

(a)  F(x)  is  absolutely  continuous. 

(b)  g(x)  can  be  expressed  as  a difference  of  two  increasing 
right  continuous  functions. 

Proof.  Suppose  (a)  holds,  then 


Hence  by  Bernoulli’s  weak  law  of  large  number  and  Dominated 
Convergence  Theorem,  we  can  immediately  establish  (7). 
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I 

♦ 


Now  suppose  (b)  holds.  By  Proposition  2 and  the  fact  that 
.F(t) 

F_.  _ (t)  = / nf?  ^ du  , we  may  write 


(8)  E 


L 1=1  J 


oo  p no  -1  W 

"I  I Qn  (F(x)  )dF(x)  dg{t)  + g(0)  / Q (F(x))dF(x) 

^oi^t  J *'0 


-/[/  Q^(F(x)  )dF(x)Jdg(t)  +g(0)  (F  (x)  ) dF(x)  , 


“OD  —CO 


where 


By  changing  order  of  integration,  the  right  hand  side  of  (8)  can 
be  simplified  to 


g(x)Q^ 


— 00 


(F(x))dF(x)  . 


Hence  (7)  holds. 

The  following  representations  for  the  moments  of  the  con- 
comitants 2,  . . . ,n)  are  needed  for  obtaining  a simple 

expression  for  Var (S^)  . 

Proposition  5.  Let  F _ (x,  ,...,x,,)  be  the 

^l'***'^k;n  ^ 


d 
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joint  cdf  of  the  k ordered  statistics 
Then 


n 


< 


. . . < X 


r 

k 


(10)  P(^[r^:n]  lyi'--"  ^[r,^:n]  - ^ 

cx.  k 

' J 'J  "t 


— GO  — OO 


and  furthermore, 


(11) 


E (Y  . , ) = E (m(X  ) ) 

[ r : n ] r ; n 


Var(Y,  ,)  = Var(m(X  ))  + E(a  (X  )) 
[r :n]  r :n  r:n 


Proof . Since  (X^,Y^)  ( i=l , 2 , . . . , n)  are  independent  and 

identically  distributed, 


P (Y  , 1 < yl X =x  , X = X. ) 

[r:n]  — ' r :n  r:n  i 

= P(Yj^  < ylX^  = X)  , 


which  does  not  depend  on  i . This  implies  that 
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1 


f 


and  1 Y)  - y P(Y  i y|X  = x)dF^.^(x) 


Similarly  we  can  show  (10)  and  thus  (11)  can  also  be  easily 
establ ished. 

In  order  to  describe  the  projection  '^[i-;n] 

Y , and  their  covariances,  we  need  the  following  results. 
[r:n] 

Proposition  6.  Suppose  + ^^[s:n]^ 

1 < r , s < n , and  m(x)  can  be  expressed  as  a difference 
of  two  increasing  right  continuous  functions.  Then  for 
1 < i < n , 


(12) 


/oo 

I(t  < X.)P  (t)dm(t) 


and 


(13) 


CovlE(Vjr,„|lXi,Vi),  E(Y(^^„,|X.,Y.)1 


= f f [F(xAy)  - F(x)F(y)  ]Pj.(x)Pg(y)dm(x)dm(y) 

— OO  */-oo 

. /\(x, 


:)P„(x)a  (x)dF(x)  , 


I 


4 
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where  P (x)  = 
s 


F(x)^  ^ [l-F(x)  ]"  ^ 


Proof . For  any  fixed  n , let  1 — ^n-l*n-l 

be  the  order  statistics  of  , X2  , . . • , ; and  let 

be  the  corresponding  concomitants  of 


'^[l:n-l]  ' • • • ''“'[n-l:n-l] 
order  statistics.  Now  for  1 < s < n , 


E (Y  . , I X =x  , Y„=y  ) 

[s:n]'  n n n-^n 


= E [Y , , I (X  , , < X --  X - ) I X ==x  , Y =y  ] 

[s:nl  s-l:n-l—  n—  s:n-l  ' n n n -“^n 

+ E [Y  . , I (X  X , , ) I X =x  , Y =y  ] 

[s:n]  n s-l:n-l  ' n n'  n n 


+ E [Y  , , I (X  > X , ) X =x  , Y =y  1 

[s:n]  n s:n-l  ' n n n -^n 

x 

= yP(x)+E(Y.  1 ^)  ~ I ra(x)dF  , , 

-'n  s'  n [s-n:n-l]'  / s-l:n-l 

*•  ^ —CO 


(x) 


m(x)dF  , (x)  . 

s : n-1 


Applying  Proposition  2 to  the  last  two  integrals,  the  resulting 
expression  can  be  simplified  to 


^<^[s-l:n-l]^  ^ <yn'^<^n’^^s^^n^ 


O 

L 


I (t  < X ) P (t)  dm  (t)  . 

— ns 
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A symmetric  argument  gives  (12).  Now  using  conditional  argument, 
conditioning  on  , we  can  easily  show  that 


= E[P^(X^)Pg(X^)o^(X^) ] 


+ Cov 


[f  Ktj^  X.)P  (t)dm(t)  , f I(t<X.)P  (t)dm(t)] 
J -oo  J-on  —IS 


By  Fubini's  theorem,  the  covariance  term  can  be  written  as 


OO  00 

If  [F  (xAy  ) -F  (x)F  (y  ) ] P^  (x ) P^  (y ) dm  (x ) dm  (y ) . 


This  completes  the  proof. 


We  shall  see  later  that  it  is  more  convenient  to  consider 


n ' ’'[i  = n|  • 


The  following  proposition  implies  that  the  contribution  of 
^[l:n]  ^[n:n]  ^n  asymptotically  negligible. 


Proposition  7.  Suppose  E(Y  ) < , and  either  F(x) 

is  absolutely  continuous  or  E(Y^|x=x)  can  be  expressed  as  a 


■* 
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difference  of  two  increasing  right  continuous  functions.  Then 

n ^ E(Y^ri  1 . , ) ♦ 0 as  n . 

[1 :n]  [n:n] 

2 

Proof . Let  g(x)  = E(Y  |x=x)  . Suppose  F(x)  is 

absolutely  continuous.  Then  we  may  write 


-1 


E (Y 


[n  :n] 


0 


g (x 


iF(x)'^"^dF(x) 


and  clearly  by  Dominated  Convergence  Theorem  it  tends  to  zero 

2 

as  n . Now  if  the  condition  of  E(Y  |x=x)  is  satisfied, 

then  by  Proposition  2 we  may  write 


-1  2 

n E(Y  . ,) 

[n:n] 


- ” 0 
= J n ^ [1-F^.^ (x) ]dg (x)  - n"^F^,^ (x) dg (x)  + n~^ 


g(0) 


Clearly  the  above  two  integrands  tend  to  zero  for  each  x as 

n -*■  0 


Since  n ^[1-F  (x)]  < [l-F(x)]  and  n~^F  (x)  < F(x 


for  all  x , and  f [1-F (x) ]dg (x)  and  f F(x)dg(x) 

0 *'-<« 

finite  by  hypothesis,  by  Dominated  Convergence  Theorem 
n-1’ 

-1 


are 


""'(n  = nl' 

-*■0  as 

n 

-*■0  as 

n 

2 . 3 Main  resul t . 


2.3  Main  result.  Now  we  are  ready  to  prove  the  main  result 
of  section  2.  We  shall  show  that  under  certain  regularity 
conditions,  is  asymptotica 1 ly  normally  distributed.  How- 

ever  we  may  consider  T = n V j(^  )Y  rather  than 

**  ^^2  I 1 : n 1 

because  and  .S^  , by  Proposition  7,  are  asymptotically 

equivalent  in  mean  square.  Theorem  1 below  and  Proposition  1 

A. 

will  show  that  T^  and  are  asymptotically  equivalent. 

Theorem  2 will  then  establish  the  asymptotic  normality  of  T^ 

and  thus  of  S . In  general,  it  turns  out  that  under  certain 
n 

regularity  conditions,  exactly  the  same  method  of  proof  can 

establish  the  asymptotic  normality  of  statistics  of  the  form 
n 

= n I J(— »Yr-.  i)  where  H(x,y)  is  some  real 
^ — ^ n » X ix*nj 

valued  function  defined  on  the  2-d imensional  Euclidean  space. 

2 

Theorem  1.  Suppose  EjY  | < • , J(u)  is  bounded  and  continuous 

a.e.  moF  ^ , m(x)  can  be  expressed  as  a difference  of  two  in- 
creasing right  continuous  function,  and  either  F(x)  is  absolutely 

2 

continuous  or  o (x)  has  the  same  property  of  m(x)  . Then 


lim  n Var (T  ) = 

n-K« 


0 (J,F)  , 


1 im  n Var (T  ) = 

n->oo 


0 (.T,F)  , 


d 


14 


► 

i 

I 

i« 


r 


I 


where  is  defined  as  in  Profosition  1,  and 


(16) 


o (J,F)  = 


/ 


J(F(x))^  o^(x)dF(x) 


+ 


IF  (xAy)  -F(x)F(y)]J(F(x))J(F(y))dm(x)dro(y)  . 


Proof.  We  shall  first  show  (14).  Let  Y.  , be  defined  as 
[r:nj 

in  Proposition  1.  Then  by  Proposition  6,  we  have 


Cov  (Y 


[r  :n] 


[s:n] 


) 


■"I//  [F  ( xA  y)  -F  ( x)  F { y)  ] P^,  ( x)  P^  ( y)  dm  ( x)  dm  (y) 


— on  — oo 


(x)  P (x)  o (x)  dF  (x) 


Then 


n { T ) 
n 


[F  (xAy)  -F  (x)  F (y)  ]Q^  (x)  (y)dm(x)dm  (y) 


^ —00 


(x)^  o^(x)dF(x) 


n-1 


where 


Now  by  the  Bernoulli's  weak  law  of  large  numbers, 

for  every  x such  that  J(u)  is  continuous  at  u = F(x)  and 

0 < F(x)  < 1 . 


15 


Since  I - 

iF(xAy) 

— CO  —CO 

= Var(Y) 

is  assumed  finite,  it  follows  from  the  Dominated  Convergence 

^ 2 

Theorem  that  n Var(T^)  ♦ o (J,F)  as  n -*•  «> 

Now  we  shall  prove  (15) . Since  by  Proposition  7 n^^^T^ 

1/2 

and  n are  asymptotically  equivalent  in  mean  square,  it 

2 

suffices  to  show  that  n Var(S  ) o (J,F)  as  n -*■  «> 

n 

By  equations  (11)  of  prop>osition  5,  we  may  write 


sup  I J (x)  I and 

X 


'JO 

-F(x)F(y)  ]dm(x)dm(y)  + o^(x)dF(x) 


n n 


(17)  n Var 


+ E[Var(Ylx  = X^,^)] 


By  Proposition  4 the  second  sum  on  the  right  hand  side  of  (17) 
converges  to 


/ 


J(F(x))^o^(x)dF(x)  as  n -*•  ® 


Let 
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G (x,y)  = 


Then  by  Proposition  3 


Cov[m(Xi:^),m(Xj:n)] 

CO  CO 

= //  [G^j(x,y)  - G^(x)Gj  (y)  ]dm(x)din(y)  , 


— on  —00 


and  hence  the  first  summation  term  on  the  right  hand  side  of 
(17)  can  be  written  as 


(18) 


^ CO  ^00 


(x,y)dm(x)dm(y) 


— Of)  —00 


n n 


where  H^(x,y)  = n I I J J (G^  ^ (x,y) -G^  (x)G  ^ (y)  ] 

i=l  j=l 

Hence  to  prove  (15)  it  remains  to  show  that 


(19)  lim 
n->-”° 


^ tX>  ^ <X> 

j J ‘'n'”' 


y)  dm(x)  dm  (y) 


— on  — oo 


-n 


[F  (xAy)  -F(x)F(y)  ]J(F(x)  )J(F(y)  )dm(x)dm(y)  . 


— OO  — OD 
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The  proof  is  identical  to  that  of  equation  (9)  in  Theorem  1 of 
Stiqler  (1974)  and  is  omitted  here.  This  completes  the 
proof  of  the  Theorem. 


Theorem  2. 


(S  -E{S^)) 
n n 

yjvar  (S^) 


N (0, 1)  as  n -*•  ® , 


provided  that  the  following  conditions  are  satisfied; 

2 2 

(i)  o (J,r)  > 0 , where  a (J,F)  is  given  in  (16). 
(ii)  E(Y^)  < . 

(lii)  J (u)  is  bounded  and  continuous  a.e.  moF  ^ . 

(iv)  m(x)  can  be  expressed  as  difference  of  two  in- 
creasing right  continuous  functions. 

(v)  Either  (x)  has  the  same  property  of  m(x)  or 

F(x)  is  absolutely  continuous. 

1/2 

Proof : Propsosition  7 implies  that  n ' (S^-E(S^))  and 

1/2 

n (T^-E(T^))  are  asymptotically  equivalent  in  mean  square, 

1/2 

and  Theorem  1 and  Proposition  1 imply  that  of  n ^ (T  -E(T  )) 

■*  n n 

1/2  ^ 

and  n (T  -E(T  ))  . Hence  it  only  remains  to  show  that 

n n ■' 

1/2  " 

n (T^-E(T^))  is  asymptotically  normally  distributed.  By 
Proposition  6 we  may  write 
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i=l 


0 

'.\f 

n-2 


[F (t) -T ( X.  < t) ]Q  ) (t)dm(t) 
1 — n 


where  Q (x)  = Y J(— ^)P.(x) 
n .^2  3 


Let  W = n ^ I Z . where 
^ i=l  ^ 


Zi  = [Y^-m(X^)  ] J (F (X 


C 

i»  * / 


[F(t)-I(X^<  t)  ] J(F  (t)  )dm(t) 


Now  , 


E[n(T  -E(T  ) - W )^1  = E{ [ Y-m (X) ] ^ [Q„ (X) -J (F (X) ) ] ^ } 
n n n n 


CO  ^00 


LL 


[F(xAy)-F(x)F(y)  ] [Q^  (x) -J  (F  (x)  ) 1 (y ) -J  (F  (y ) ) ] 


dm(x)dm(y)  . 


Since  ^ J(F(t))  a.e.  moF  ^ as  n -►  ® r t>y  Dominated 

1/2  2 

Convergence  Th€»rem  we  can  show  that  E[n  ' ^*^n^  ~^n^  ^ ® 

as  n ->  <»  . 


Since  the  Z^  are  i.i.d.  random  variables  with  zero  mean  and 

2 1/2 
variance  o (J,F)  , by  Central  Limit  Theorem,  n is 
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2 1/2''^ 
asymptotically  N(0,o  (J,F))  , and  so  is  n ' (T  -E(T  ))  . 

n n 

This  completes  the  proof. 

Since  statistics  of  the  form  S are  usually  used  as 
estimates  of  their  expectation,  the  limiting  value  of  E(S^) 
is  of  interest.  The  following  theorem,  which  is  a direct 
consequence  of  Proposition  4,  gives  the  limiting  value  of 
E(S„)  . 

Theorem  3.  Suppose  E(|  Y |)  < and  J(u)  is  bounded 
and  continuous  a.e.  . Then 


(20)  lim  E(S  ) 
„ n 


J(F(x))m(x)dF(x) 


— OO 


provided  one  of  the  following  conditions  is  satisfied: 


(a)  m(x)  can  be  epxressed  as  a difference  of  two  in- 
creasing right  continuous  function  of  x . 

(b)  F(x)  is  absolutely  continuous. 


Inspection  of  the  proofs  of  Theorem  1 through  3 reveals 
that  exactly  the  same  arguments  used  above  can  be  employed  to 
prove  the  following  theorem  concerning  the  asymptotic  distribution 
of  . 


n 


Theorem  4 


Let 


= n 


-1 


I J(-4r)H(X.  ,Y,  . ,) 

n+1  i:n'  [i:n] 


i 
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-t(x)  = E [H  (X,  Y)  I X=xl  and  t^(x)  = E{  [H  ( X,  Y) -a  (X)  ] ^ I X=x  } . 


Suppose  the  following  conditions  are  satisfied: 

(i)  J(u)  is  bounded  and  continuous  a.e.  moF 
2 


-1 


(ii)  E(H(X,Y)  ) < . 

(iii)  a(x)  can  be  expressed  as  a difference  of  two 

increasing  right  continuous  functions. 

2 

(iv)  Either  t (x)  has  the  same  property  of  a(x) 
or  F(x)  is  absolutely  continuous. 


Then 


(21)  lim  n Var(()) 

n-»oo 


J(F(x)  ) ^ T^(x)dF(x) 


+ y*'y  [F(xAy)-F(x)F(y)U(F(x)  )J(F(y)  )da(x)da(y)  , 


.fXi 

» QO  00 


_ 00  — oo 


and 

(22)  lim  E(4) 

n-cm 


) J(F  (x)  )dF(x)  . 


Furthermore  if  the  asymptotic  variance  is  positive,  then 


(23) 


(♦„  - E(«^)) 


\ Var((()^) 


N(0,1)  as  n-*-°°. 


Remark  1 . Let  H(x,y)  = h(x)  . Theorem  4 establishes  the 

-1 

asymptotic  normality  of  = n~  I with  asymptotic 

i=l 


variance 
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(F(xAy)-F(x)F(y)  ] J (F  (x)  ) J (F  (y ) ) dh  (x)  dh  (y)  . 


Remark  2.  Let  H(x,y)  = (y-m(x))  . Then  Theorem  4 establishes 

the  asymptotic  normality  of 


R = 
n 


-1 


n 

I J( 

i=l 


n+1  ‘ 


[Yf.  ,-m(X.  )] 

[ 1 : n]  ' 1 : n 


with  asymptotic  variance 
that  because  of  the  special  form  of  H(x,y) 


L 


J (F  (x) ) ^ 0^ (x) dF 


of  Theorem  4 can  be  omitted  here. 

n 


(x)  . Note  also 

condition  (iii) 


Remark  3.  Let  S = n ) J ( — rr) Y , • i • Examination  the 

n n n+1  [i:nj 

1=1 

proofs  of  section  2 immediately  reveals  that  Theorem  1 through 

4 apply  equally  well  to  as  long  as  is  uniformly  bounded, 

and  for  every  continuity  point  u^  of  J there  is  an  open 

neighborhood  of  u«  in  which  J (u)  "*■  J(u)  uniformly. 

u n 


3.  Application 

3.1  Estimation.  In  this  section  the  technique  developed  and 
results  obtained  in  section  2 are  applied  to  construct  consistent 
estimators  of  various  conditional  quantities  based  on  statistics 
of  the  form 


^n  = 


-1 


n 

I 

i=l 


J (i)  H(X.  ,Y..  ,) 

n n i:n'  [i:n] 
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Under  certain  regularity  conditions,  is  also  asymptotically 

nor.nally  distributed.  We  shall  first  prove  the  following  theorem 
which  will  give  sufficient  condition  for  M to  be  a consistent 
estimator  for  a(x)  = E [H (X, Y) | X=x]  , 


Theorem  5. 


satisfied.  Let  J (u)  = h( 

n 


Suppose  conditions  (ii)  to  (iv)  of  Theorem  4 are 
/u-F  (x„)\ 

n)  k( 1 where  h(n)  -*■  0 

\ h(n)  ' 


as  n -»•  oc  and  F (x)  is  the  emprical  distribution  of  the  X. 
In  addition,  the  following  conditions  are  also  assumed  to  be 
satisfied : 

There  exists  constant  M ( > 0)  such  that 


(i) 

(ii) 

(iii) 

(iv) 

(v) 


jK(t^)-K(t2) 1 < Mlt^-t2 
1 tK(_t)  1-0  as  Itj  - 
(t)dt  = 1 . 


for  all  t^  and  t2  . 


h 

— CO 

lim  h(n)'^f-^^2_i2^\ 

n-«.  V ^ / 


1/4 


= 0 


:xoF  ^ (u)  = E(H(X,Y)  |X=F  ^ (u)  ) is  continuous  at 
^0  ^^^0^  ‘ 


Then 


(24) 


lim  E(M  ) = a(x.)  , 

n-*oo 


and 

(25) 


lim  E(M„-a(x.) ) ^ = 0 
n-«  " 0 


•i. 
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Before  proving  Theorem  5,  we  shall  first  prove  the  following 
lemma  which  will  be  useful  for  proving  (24)  and  the  next  theorem. 


Lemma  1 . Let  K(t)  be  defined  as  in  Theorem  5 and 
p(i;n,u)  = ^(1-u)^  ^ , 0 u £ 1 . If  condition  (iv) 

of  Theorem  5 is  satisifed,  then 

■ ^ \ I 

p ( i ; n , u ) 0 


uniformly  in  u as  n -*• 


Proof.  By  (i)  of  Theorem  5,  we  may  write 


n 1 

f“  / 

-1 


I h(n) 
i=l 


p ( i ; n , u ) 


£ M Ih(n)  ^ p(i;n,u) 

i=l  " 


Now  the  Law  of  Iterated  Logarithm  for  the  sum  of  i.i.d. 
Bernoulli's  random  variables  and  condition  (iv)  imply  the 
conclusion  of  the  lemma. 

Proof  of  Theorem  5.  Let 


M*  = n'l  »«i:n'hi  = nl>  • 


I 


i 
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★ 

Then  and  are  asymptotically  equiva  it  in  mean  square. 

To  see  this,  write 


(26) 


h (n) 


-1 


\ ~ h(n)  / \ h(n)  j 


- F(x„) 


£ M h(n)  ^ |Fj^(Xq)  - F(Xq)  I . 


Then  condition  (iv)  and  the  Law  of  Iterated  Logarithm  implies 

that  with  probability  one  (26)  converges  to  zero  uniformly  in 

* 2 

i as  n “ . IJow  it  is  easy  to  check  that  E(M  -M„)  ‘ 0 

■'  n n 

as  n 

★ 

Hence  we  nay  consider  M rather  than  M . We  shall 

n n 

★ 

first  show  that  E(M  ) -+  a(x„)  as  n “ , As  in 

n 0 

Profxjsition  4,  we  may  write 


(27) 


/OO 

Q*  (F(x)  )a  (x)dF(x)  , 


where  Q*(u)  - h (n) u"-hl-u)"‘^  . 


Lemma  1 implies  that  the  limiting  value  of  (27)  is  same  as  that 
of 


(28) 
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With  the  given  conditions  on  K(t)  and  aoF~^ (u)  , it  is 

easy  to  show  that  the  limiting  value  of  (28)  is  “^^0^  ' ^ 

proof  may  essentially  be  found  in,  e,g.,  Parzen  (1962). 

★ 

To  prove  (25)  , it  remains  to  show  that  Var(M  ) -*■  0 

n 

2 * 

as  n -►  ® . But  by  Remar)c  3,  nh(n)  Var(M  ) + 0 as  n “ 

n 

* 

which  implies  that  of  Var(M^)  . This  completes  the  proof  of 
the  Theorem. 


Remar  It  4 . Now  it  is  clear  that  if  the  appropriate  conditions 
are  satisified. 


and 


M 


nl 


n 


«n3  = ’'U:nl  ‘ 


M 


nl 


are  respectively  consistent  estimators  of  m(Xp)  , 

P(Yca1x=Xq)  and  Var(Y|x=XQ)  . ' 

Next  we  shall  prove  the  following  theorem  which  will  give 

* . ^ -1 

sufficient  conditions  for  M = n J h(n)  K( — t-t — c ) H(X.  ,Y,.  ,) 

n \ h(n)  y i:n'  [i:n]  ^ 

to  be  asymptotically  normally  distributed.  Then  the  asymptotic 

1/2 

normality  of  will  be  established  by  showing  that  (h(n)n) 

1/2  * 

and  (h(n)n)  are  asymptotically  equivalent  in  mean  square. 


’ULjrasYi’^ 
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i - u 

Theorom  6.  Let  M = n ^ ^ h(n)  ^k(  < P- ) H(X.  _»Yr-  _i 

n \ h(n)  j i:n  [i:n] 

Suppose  the  assumptions  of  Theorem  5 are  satisfied, 

E[H(X,Y)^)  < “ , u'(x)  exists  and  m'oF  ^ (u)  is  continuous 

at  Uq  with  0 < Uq  < 1 . Then 


(n  h(n)  (M*-E(M*)  ) 1 ►N(0,y^(Uq))  as  n^ 


where  y 


t^oF 


Luq)  f K 


K(t)  dt  . 


Prop f . For  easier  presentation,  we  shall  prove  the  special 


case 


n i _ \ 

M*  = n“^  J h (n)  ) Y , . , • 

n \ h(n)  / [i:n] 

Similar  arguments  can  be  used  to  prove  the  general  case.  Let 

n /i.  _ \ 


* * * 

B = M - A . 
n n n 


Then  clearly, 

1/2  * * 1/2  * * 1/2  * 
(n  h(n)  (M„-E(M„)  ) = (n  h (h)  ) ^ (A„-E  (A^)  ) + (n  h (n) ) ^ B„ 

n n n n n 


We  shall  first  show  that  nh(n)  Var  (A^)  -►0  as  n -*■  >»  , and 
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1/2  * 

then  the  asymptotic  normality  of  (nh(n))  , which  will 

1/2  * * 

imply  that  of  (nh(n))  (Mj^-E(M^))  . 

As  in  Theorem  1,  we  may  write 


* r r * 

nh(n)Var(A^)  = / / (x , y)  dm  (x)  dm  (y)  , 


*•00  >*00 


where 


H^(x,y) 


and  G^j(x,y)  and  G^(x)  are  defined  as  in  Theorem  1.  Applying 
the  same  type  of  argument  used  to  prove  Lemma  1,  we  can  easily 
show  that 

|H„ix.y) -hi")  %-hTKT— ) ( h(n)~ ) Ifc<-yi-i'ix)''(y)i| 

-*•  0 uniformly  in  x and  y as  n -►  ® . Hence  we  have,  as 


n ♦ oo 


(29)  n h(n)  Var  (Aj^) 


^ I f (uAv-uv)m’oF  ^(u)m’oF  ^ (v) 


dudv 


0 0 
0(1)  . 


-1 


But  we  can  easily  show  that  the  limiting  value  of  h(n)  times 
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the  integral  term  of  the  right  hand  side  of  (29)  is 


Uq  (1-Uq)  Im'oF 


'"'“o’  L " 


(t)dtl  (cf.  Cacoullas,  1966). 


Hence  lim  nh(n)  Var  (A  ) = 0 . 

n 
n 

* . . . 
Let  B be  the  projection  of  B . As  in  Proposition 
n n 

6,  it  can  be  written  as 


n 

B*  = n"^  y (Y.-m(x. ) )Q* (F(X. ) ) , 

n 1 1 n 1 


where  Q (t)  is  def  ned  as  in  (27)  of  Theorem  5.  Moreover, 
n 


we  can  also  write 


(30)  n h(n)  Var  (B 


/•  1 " /i  - u 

~ f I h(n)  j p(i;n,u)o^oF  ^(u)du  , 

^ •'0  i=l  ' ' 


(31)  nh(n)Var(B*)  = / h (n)  Q (u)  ^ o^oF~^  (u)  du 

J 0 ^ 


Using  similar  arguments  as  that  for  deriving  (24)  of  Theorem  5, 
we  can  easily  show  that  the  limiting  values  of  (30)  and  (31)  are 
both  equal  to 


Y^(Uq)  = o^oF” 


huo>  / K 

^ _nr. 


(t)^dt  . 


1/2  * 1/2 

Hence  (nh(n))  ' and  (nh(n))  , by  Proposition  1 , 


are  asymptotically  equivalent  in  mean  square.  Now  if  we  define 
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* 


-1 

n 


n 


I z 


i=l 


in 


where 


in 


= (Y  - m(X  . ) 
1 1 


h(n) 


y h ( n ) J 


\ 


I 


then 

H2)  E[n  h(n)  (B*  -W*) 

\ 9 * ^ ~'^0\  ? 

= h(n)  E • (Y^-m(X^)  ) (Q^  (F  (X^^ ) ) -h  (n)  j] 

Clearly  the  right  hand  side  of  (32)  converges  to  zero  and  thus 
1/2^*  1/2* 

(nh(n))  and  (nh(n))  ' are  asymptotically  equivalent 

in  mean  square.  is  sum  of  independent  identically  dis- 
tributed random  variables  (i  = l,,,.,n)  with  zero  means 

2 

and  lim  h(n)Var(Z.^)  = y ^^0^  ' also  easy  to  check 

n-*oD 

that  the  sufficient  conditions  for ' Liapounov ' s Central  Limit 

Theorem  for  double  sequence  of  random  variables  are  satisfied 

1/2  ^ 

for  the  . Therefore  (nh(n))  ' is  asymptotically 

2 1 /2  ^ 

N(0,Y  (u«)  ) , so  is  (nh(n))  ' B„  and  the  theorem  follows, 

u n 

Theorem  6 can  be  used  to  construct  approximate  confidence 

-1  * 

interval  for  aoF  (Uq)  if  we  can  replace 

-1  1/2  * 
aoF  (Uq)  . In  other  words  we  need  lim  (nh(n))  ' [E(M  ) - 

uoF  (Uq) ] = 0 . The  following  corollary  will  allow  us  to 

do  this  when  certain  conditions  are  met. 


id 
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Corollary  1.  Suppose  the  assumptions  of  Theorem  6 are 
satisfied,  and  in  addition  the  {ollowing  conditions  are  also 
satisf ied : 


(a) 

(b) 


I 

/ 


zK(z)dz  = 0 


z Ik ( z)  Idz  < 


(c)  K"(z)  exists  and  satisfies  (i)  and  (ii)  of  Theorem  5. 

(d)  The  second  derivative  of  g(u)  = loF  ^(u)  exists 
and  is  continuous  at  u^  . 

/CO 

K(z)dz  . 

'00 

Furthermore,  if  lim  h(n)n^'^^  = 0 , then 


n ■>on 


[(nh(n))^/^(M*-g(uQ)))  - N(0,y^(Uq)) 


as  n , where  y (Uq)  is  defined  as  in  Theorem  6, 


Proof.  Write 


E(M  ) - g(u.)  !/h(n)  ^ 


<11^1+1121+113!  » where 


Si 
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= h(n) 


-2 


g(uQ)du  , 


uX  [0,11 


= h(n)-2j  h(n)-l 

r\  1 X L f 


p (i;n,u)g (u)du  , 


= h{n)~^J'  h(n)~^  (g  (u) -g  (u^)  )du  , 

and  p(i;n,u)  is  defined  as  in  Lenuna  1. 

Clearly  for  sufficiently  large  n , 

Ui  I 1 I / z ^ 1 K ( z ) I d Z 

u/:  I-Ug/hln)  , (l-UQ)/h(n)  ) 


and  hence  1^2^  I tends  to  zero  as  n ^ . 

By  the  mean  value  theorem  of  the  second  order  we  may  write 

2 


I2  = h(n) 


p ( i; n,u) g (u) du  , where  jo^l  ^ 1 . 

Since  by  assumption  K"(t)  satisfies  properties  (i)  and  (ii)  of 
K(t)  , similar  arguments  used  to  derive  (24)  will  enable  us  to 


show  that 
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+ 0(l/(n  h(n)  )"') 


and  this  implies  that  "*■  0 as  n 

Using  the  mean  value  theorem  of  the  second  order  and 
assumption  (a)  , we  may  write 


I3  = g'(uQ) 


J"  h(n)  ^zK(z)dz  + 

z/  [-UQ/h(n) , (l-UQ)/h(n)  ] 


/ 


(1-Uq)  /h  (n) 


-u^/h (n) 


z'^K(z)g"(6  h(n)z  + u_)dz  , 


n 


where  6 < 1 

‘ n ' — 


Since  by  assumption  (b)  , / z |K(z)|dz  < 

the  first  integral  tends  to  zero  as  n . By  assumption. 


, f 


g"(u)  is  continuous  at  u^  . Hence  the  second  integral  tends 


to  g 
follows . 


z^K(z)dz  as  n -*■  >»  . Now  clearly,  the  corollar 


Remark  5. 


Let 
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<3-  "''J,  >’'''>''KVsf)’'li:nl  - '<!>'  ' 


If  all  the  appropriate  conditions  are  satisfied,  then  the 

approximate  (l-a)100%  confidence  intervals  for  moF  ^(Uq) 

and  P(Yea1x=F  ^ (Uq))  are  respectively 

* ★ 1/9—1  * * 1/2—1 

M ,±[M  ,C/ (nh(n)  ) ] '^  4>  '^{a/2)andM  -±[M  ^(1-M  _)C/(nh(n))]  ' (a/2) 

ni  nl  n/  n^ 


where 


(t)  dt  and  $ is  the  cdf  of  the  standard 


normal  random  variables.  An  example  of  K(t)  fulfilled  all 

the  requirements  of  Corollary  1 is  the  pdf  of  the  N(0,1) 

variate.  Note  also  that  with  this  type  of  K(t)  , Theorem  5 

2 

remains  valid  if  we  replaced  condition  (iv)  by  lim  h(n)  n = “ . 

n-*-oo 

In  order  to  have  the  same  results  for  M , we  need 

n 

* 2 

E[nh(n)  (M  -M  ) ] •+  0 as  n “ . Inspection  of  the  proof 

n n 

* 2 

of  E(M^-M^)  -►  0 as  n -»■  <»  in  Theorem  5 leads  immediately 

to  the  following  corollary. 

Corollary  2.  Theorem  6 and  Corollary  1 continue  to  hold 
for  if  the  condition  (i)  of  Theorem  6 is  replaced  by 

the  following  condition: 

There  exists  constants  M ( > 0)  and  a ( > 3/2)  such 
that  I K (tj^ ) -K  ( t2)  1 £ Mltj^-t2l'^  for  all  t^^  and  t2  . 


i 
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Remar k 6 . An  example  of  K(t)  possessed  all  the  requirements 

2 2 1/2 

of  Corollary  2 is  t exp  ( -t  /2 ) / ( 2ti  ) . If  all  the  appropriate 

conditions  are  satisfied,  then  the  approximate  (l-a)100% 
confidence  intervals  for  m(xQ)  and  P(YcA|x=Xq)  are  re- 
spectively t (nh  (n  ) ) ] ^ (a/2)  and 

M _ • [M  _(1-M  _)c/(nh  (n)  ) ] ^(i/2)  where  C and  ^ are 

n2  n2  n2 

defined  as  in  Remark  5. 


3.2  Testing  a specified  regression  function.  The  statistic 

R as  defined  in  Remark  2 can  be  used  to  construct  large 
n 

sample  tests  concerning  a specified  regression  function. 

For  example  we  wish  to  test  the  null  hypothesis  Hq  : m(x)  = 
against  the  alternative  hypothesis  ; m(x)  > . By 

Remark  2 under  H ^,j(n^^^R  /V)  -*-N(0,l)  as  n-*-°“  , where 

J(F(x))^  a^(x)dF(x)  . Theorem  4 implies  that 

— 00 


n 


V 


= I 

i=l 


-1 


J( 


n+1 


) [Y 


[i:n] 


- m (X. 
o 1 : 


n 


) 1 


is  a consistent  estimator 
a test  is  to  reject 
4>  is  the  standard  normal 


2 

of  V . Hence  a large  sample  size 
if  n^'^^R^/V^  ^ 4>  ^(1-a)  where 

c.d. f . 
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